Segmental Spatiotemporal CNNs for Fine-grained Action Segmentation

Joint segmentation and classification of fine-grained actions is important for applications of human-robot interaction, video surveillance, and human skill evaluation. However, despite substantial recent progress in large-scale action classification, the performance of state-of-the-art fine-grained action recognition approaches remains low. We propose a model for action segmentation which combines low-level spatiotemporal features with a high-level segmental classifier. Our spatiotemporal CNN is comprised of a spatial component that uses convolutional filters to capture information about objects and their relationships, and a temporal component that uses large 1D convolutional filters to capture information about how object relationships change across time. These features are used in tandem with a semi-Markov model that models transitions from one action to another. We introduce an efficient constrained segmental inference algorithm for this model that is orders of magnitude faster than the current approach. We highlight the effectiveness of our Segmental Spatiotemporal CNN on cooking and surgical action datasets for which we observe substantially improved performance relative to recent baseline methods.Comment: Updated from the ECCV 2016 version. We fixed an important mathematical error and made the section on segmental inference cleare

Chemical Tools for Studying TLR Signaling Dynamics

Therapeutic cell differentiatio

Quantification of Bioorthogonal Stability in Immune Phagocytes Using Flow Cytometry Reveals Rapid Degradation of Strained Alkynes

Bio-organic Synthesi

An alternative model for type I interferon induction downstream of human TLR2

Surface-exposed Toll-like receptors (TLRs) such as TLR2 and TLR4 survey the extracellular environment for pathogens. TLR activation initiates the production of various cytokines and chemokines including type I interferons (IFN-I). Downstream of TLR4, IFNβ secretion is only vigorously triggered in macrophages when the receptor undergoes endocytosis and switches signaling adaptor; surface TLR4 engagement predominantly induces proinflammatory cytokines via the signaling adaptor MyD88. It is unclear if this dichotomy is generally applicable to other TLRs, cell types, or differentiation states. Here, we report that diverse TLR2 ligands induce an IFN-I response in human monocyte-like cells, but not in differentiated macrophages. This TLR2-dependent IFN-I signaling originates from the cell surface and is dependent on MyD88; it involves combined activation of the transcription factors IRF3 and NF-κB, driven by the kinases TBK1 and TAK1-IKKβ, respectively. TLR2-stimulated monocytes produced modest IFNβ levels that caused productive downstream signaling, reflected by STAT1-phosphorylation and expression of numerous interferon-stimulated genes (ISGs). Our findings reveal that the outcome of TLR2 signaling includes an IFN-I response in human monocytes, which is lost upon macrophage differentiation, and differs mechanistically from IFN-I-induction through TLR4. These findings point to molecular mechanisms tailored to the differentiation state of a cell and the nature of receptors activated to control and limit TLR-triggered IFN-I responses.Bio-organic Synthesi

Metabolic labeling probes for interrogation of the host-pathogen interaction

Bacterial infections are still one of the leading causes of death worldwide; despite the near-ubiquitous availability of antibiotics. With antibiotic resistance on the rise, there is an urgent need for novel classes of antibiotic drugs. One particularly troublesome class of bacteria are those that have evolved highly efficacious mechanisms for surviving inside the host. These contribute to their virulence by immune evasion, and make them harder to treat with antibiotics due to their residence inside intracellular membrane-limited compartments. This has sparked the development of new chemical reporter molecules and bioorthogonal probes that can be metabolically incorporated into bacteria to provide insights into their activity status. In this review, we provide an overview of several classes of metabolic labeling probes capable of targeting either the peptidoglycan cell wall, the mycomembrane of mycobacteria and corynebacteria, or specific bacterial proteins. In addition, we highlight several important insights that have been made using these metabolic labeling probes.Microbial Biotechnolog

Application of a highly selective Cathepsin S two-step activity-based probe in multicolor bio-orthogonal correlative light-electron microscopy

Cathepsin S is a lysosomal cysteine protease highly expressed in immune cells such as dendritic cells, B cells and macrophages. Its functions include extracellular matrix breakdown and cleavage of cell adhesion molecules to facilitate immune cell motility, as well as cleavage of the invariant chain during maturation of major histocompatibility complex II. The identification of these diverse specific functions has brought the challenge of delineating cathepsin S activity with great spatial precision, relative to related enzymes and substrates. Here, the development of a potent and highly selective two-step activity-based probe for cathepsin S and the application in multicolor bio-orthogonal correlative light-electron microscopy is presented. LHVS, which has been reported as a selective inhibitor of cathepsin S with nanomolar potency, formed the basis for our probe design. However, in competitive activity-based protein profiling experiments LHVS showed significant cross-reactivity toward Cat L. Introduction of an azide group in the P2 position expanded the selectivity window for cathepsin S, but rendered the probe undetectable, as demonstrated in bio-orthogonal competitive activity-based protein profiling. Incorporation of an additional azide handle for click chemistry on the solvent-exposed P1 position allowed for selective labeling of cathepsin S. This highlights the influence of click handle positioning on probe efficacy. This probe was utilized in multicolor bio-orthogonal confocal and correlative light-electron microscopy to investigate the localization of cathepsin S activity at an ultrastructural level in bone marrow-derived dendritic cells. The tools developed in this study will aid the characterization of the variety of functions of cathepsin S throughout biology.Microscopic imaging and technolog

Application of a highly selective cathepsin S two-step activity-based probe in multicolor bio-orthogonal correlative light-electron microscopy

Cathepsin S is a lysosomal cysteine protease highly expressed in immune cells such as dendritic cells, B cells and macrophages. Its functions include extracellular matrix breakdown and cleavage of cell adhesion molecules to facilitate immune cell motility, as well as cleavage of the invariant chain during maturation of major histocompatibility complex II. The identification of these diverse specific functions has brought the challenge of delineating cathepsin S activity with great spatial precision, relative to related enzymes and substrates. Here, the development of a potent and highly selective two-step activity-based probe for cathepsin S and the application in multicolor bio-orthogonal correlative light-electron microscopy is presented. LHVS, which has been reported as a selective inhibitor of cathepsin S with nanomolar potency, formed the basis for our probe design. However, in competitive activity-based protein profiling experiments LHVS showed significant cross-reactivity toward Cat L. Introduction of an azide group in the P2 position expanded the selectivity window for cathepsin S, but rendered the probe undetectable, as demonstrated in bio-orthogonal competitive activity-based protein profiling. Incorporation of an additional azide handle for click chemistry on the solvent-exposed P1 position allowed for selective labeling of cathepsin S. This highlights the influence of click handle positioning on probe efficacy. This probe was utilized in multicolor bio-orthogonal confocal and correlative light-electron microscopy to investigate the localization of cathepsin S activity at an ultrastructural level in bone marrow-derived dendritic cells. The tools developed in this study will aid the characterization of the variety of functions of cathepsin S throughout biology.Bio-organic Synthesi

Citrullinated human and murine MOG_35–55 display distinct biophysical and biochemical behavior

The peptide spanning residues 35 to 55 of the protein myelin oligodendrocyte glycoprotein (MOG) has been studied extensively in its role as a key autoantigen in the neuroinflammatory autoimmune disease multiple sclerosis. Rodents and nonhuman primate species immunized with this peptide develop a neuroinflammatory condition called experimental autoimmune encephalomyelitis, often used as a model for multiple sclerosis. Over the last decade, the role of citrullination of this antigen in the disease onset and progression has come under increased scrutiny. We recently reported on the ability of these citrullinated MOG35–55 peptides to aggregate in an amyloid-like fashion, suggesting a new potential pathogenic mechanism underlying this disease. The immunodominant region of MOG is highly conserved between species, with the only difference between the murine and human protein, a polymorphism on position 42, which is serine in mice and proline for humans. Here, we show that the biophysical and biochemical behavior we previously observed for citrullinated murine MOG35–55 is fundamentally different for human and mouse MOG35–55. The citrullinated human peptides do not show amyloid-like behavior under the conditions where the murine peptides do. Moreover, we tested the ability of these peptides to stimulate lymphocytes derived from MOG immunized marmoset monkeys. While the citrullinated murine peptides did not produce a proliferative response, one of the citrullinated human peptides did. We postulate that this unexpected difference is caused by disparate antigen processing. Taken together, our results suggest that further study on the role of citrullination in MOG-induced experimental autoimmune encephalomyelitis is necessary.</p

Lymphocryptovirus Infection of Nonhuman Primate B Cells Converts Destructive into Productive Processing of the Pathogenic CD8 T Cell Epitope in Myelin Oligodendrocyte Glycoprotein.

EBV is the major infectious environmental risk factor for multiple sclerosis (MS), but the underlying mechanisms remain obscure. Patient studies do not allow manipulation in vivo. We used the experimental autoimmune encephalomyelitis (EAE) models in the common marmoset and rhesus monkey to model the association of EBV and MS. We report that B cells infected with EBV-related lymphocryptovirus (LCV) are requisite APCs for MHC-E-restricted autoaggressive effector memory CTLs specific for the immunodominant epitope 40-48 of myelin oligodendrocyte glycoprotein (MOG). These T cells drive the EAE pathogenesis to irreversible neurologic deficit. The aim of this study was to determine why LCV infection is important for this pathogenic role of B cells. Transcriptome comparison of LCV-infected B cells and CD20(+) spleen cells from rhesus monkeys shows increased expression of genes encoding elements of the Ag cross-presentation machinery (i.e., of proteasome maturation protein and immunoproteasome subunits) and enhanced expression of MHC-E and of costimulatory molecules (CD70 and CD80, but not CD86). It was also shown that altered expression of endolysosomal proteases (cathepsins) mitigates the fast endolysosomal degradation of the MOG40-48 core epitope. Finally, LCV infection also induced expression of LC3-II(+) cytosolic structures resembling autophagosomes, which seem to form an intracellular compartment where the MOG40-48 epitope is protected against proteolytic degradation by the endolysosomal serine protease cathepsin G. In conclusion, LCV infection induces a variety of changes in B cells that underlies the conversion of destructive processing of the immunodominant MOG40-48 epitope into productive processing and cross-presentation to strongly autoaggressive CTLs

Super-resolution correlative light-electron microscopy using a click-chemistry approach for studying intracellular trafficking

Correlative light and electron microscopy (CLEM) entails a group of multimodal imaging techniques that are combined to pinpoint to the location of fluorescently labeled molecules in the context of their ultrastructural cellular environment. Here we describe a detailed workflow for STORM-CLEM, in which STochastic Optical Reconstruction Microscopy (STORM), an optical super-resolution technique, is correlated with transmission electron microscopy (TEM). This protocol has the advantage that both imaging modalities have resolution at the nanoscale, bringing higher synergies on the information obtained. The sample is prepared according to the Tokuyasu method followed by click-chemistry labeling and STORM imaging. Then, after heavy metal staining, electron microscopy imaging is performed followed by correlation of the two images. The case study presented here is on intracellular pathogens, but the protocol is versatile and could potentially be applied to many types of samples.Microscopic imaging and technolog